arXiv: 1506.01582vl [math.OC] 4Jun2015 


A unified approach to convergence rates for 
^^-regularization and lacking sparsity 

Jens Flemming, Bernd Hofmann, Ivan Veselic * 

June 5, 2015 


Abstract 

In ^^-regularization, which is an important tool in signal and image 
processing, one usually is concerned with signals and images having 
a sparse representation in some suitable basis, e.g. in a wavelet basis. 

Many results on convergence and convergence rates of sparse approxi¬ 
mate solutions to linear ill-posed problems are known, but rate results 
for the .^^-regularization in case of lacking sparsity had not been pub¬ 
lished until 2013. In the last two years, however, two articles appeared 
providing sufficient conditions for convergence rates in case of non- 
sparse but almost sparse solutions. In the present paper, we suggest 
a third sufficient condition, which unihes the existing two and, by the 
way, also incorporates the well-known restricted isometry property. 

MSC2010 subject classification: 65J20, 47A52, 49N45 

Keywords: Linear ill-posed problems, Tikhonov-type regularization, spar¬ 
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1 Introduction 

The method of ^^-regularization as a variety of Tikhonov-type regularization 
became of significant interest in the past ten years, mainly driven by its 
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applications in signal processing and imaging. We consider a bonnded linear 
operator A : —)■ Y mapping from into a Banach space Y. The 

idea is to solve with some exponent 1 < p < oo the minimization problem 

IIAx — ?/'^||y + a;||x|l£i(N) —> niin, snbject to x = G(1.1) 

with minimizers x^ as an auxiliary problem for finding a solution x^ = (x|,)^^ 
of the linear operator equation 

Ax = y, X e ^^(N), y ^Y, (1.2) 

with exact right-hand side y from the range 'R-{A) of the operator A and 
for available data y^ E Y which are characterized by the deterministic noise 
model 

\\y-y^\\Y<S (1.3) 

with noise level <5 > 0. The regularization parameter a > 0 in (II.ip controls 
the influence of the penalty term ||x||£ 1 (n), hence the trade-off between data 
fidelity and approximation. For details on the theoretical background of 
^^-regularization we refer to [U [71 HSl HU HU [20]. 

The problems (11.2p and (II.ip are motivated by the assumption that for 
a separable infinite dimensional Hilbert space X with inner product (•> ■)x, 
some orthonormal basis {u^^'^}k£N and for an injective and bounded linear 
operator A : X ^ Y the solutions of the operator equation 

Ax = y, xEX,yEY, (1.4) 

are sparse in the sense that only a finite number of basis elements 
becomes active in the solution. This means that the associated sequence 
a; = {xk)T=i ■= of Fourier coefficients for the solution to (II.4p 

is in .^°(N). Taking into account the restriction to £^(M) of the synthesis 
operator 

OO 

L : X e £^(rd) ^ ^XkU^^^ e x 
k=l 

and setting A := A o L it makes sense to solve (II.ip due to x^ G ^°(N), i.e., 
because the minimizers of (II.ip (which always exist - not necessarily unique 
- and depend stably on the data y^) are sparse (cf. [U Proposition 2.8]). 
Since the synthesis operator L : £^(N) —)■ X is injective and bounded, the 
linear operator A : £^(M) —?■ H is also injective and bounded if A : X —)■ H 
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is. In [T^ Proposition 4.6] we have shown that the operator equation (II.ip 
with A = A o L as introduced above is always ill-posed, i.e. TZ{A) ^ TZ{A), 
and even ill-posed of type II in the sense of Nashed (cf. [H]). This is an 
additional motivation for the use of a regularization method like (11. ip for the 
stable approximate solution of equation (II.2p . 

In [S] and m for linear problems (II.2p . as well as in jB] for nonlinear 
problems, it was shown that the ^^-regularization based on (II.ip is also ap¬ 
plicable if the exact solution G to (II.2p . which is unique for injective 

A, is not sparse but almost sparse. This means that components decay fast 
enough. In fact, the assumption G suffices to obtain convergence 

rates for the convergence of the minimizers to the exact solution if the 
unit sequences 

:= (0,..., 0,1,0,...) (with 1 at position k) 

and the operator A fit together well. The faster the components \x\\ of x^ 
decay to zero as /c —)■ oo, the faster is the convergence. 

The aim of the present paper is to unify the assumptions used in [8] and 
m to prove convergence rates. As a byproduct also the so called restricted 
isometry property appearing frequently in connection with the reconstruction 
of sparse signals (see, e.g., 13) will be covered by our unified setting. 

The structure of the paper is as follows: In Section [2] we present the new 
setting and prove convergence rates on its basis. Sections [3] and 0] relate the 
approaches from |8] and m, respectively, to the new setting and Section [5] 
incorporates the restricted isometry property. Moreover, Section [6] provides 
two examples and Section [7] completes the paper with some outlook. 


2 Sufficient condition for convergence rates 

To prove convergence rates for ^^-regularization we use the powerful tech¬ 
nique of variational inequalites (also known as variational source conditions 
or variational smoothness assumptions), that is, we show that there are a 
constant /3 G (0,1] and a concave index function (p : [0, oo) —)■ [0, oo) such 
that 


I3\\x - x3g(n) < l|a:^||G(N) - - ^x^Wy) for all x G £^(N). 

( 2 . 1 ) 
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Here, a function y? is called index function if it is continuous and strictly 
increasing with (/?(0) = 0. Note that a variational inequality (12.ip is closely 
connected with the injectivity of A (cf. [H Proposition 5.6]). Therefore we re¬ 
strict our considerations in this paper to the case of injective linear operators 
A. Based on (12.ip convergence rates 

if 50, 

can be shown without any further assumptions, where a = y^) has to be 

chosen in one of several possible ways. Details on the technique of variational 
inequalities for obtaining convergence rates in Tikhonov-type regularization 
can be found in[Il|2l[5l[ini[l3l[l5l[l6l[22]. 

Before we come to the convergence rate result, we introduce some nota¬ 
tion: By sgnx for x G we denote the £°°-sequence dehned by 

{ 1, if Xk > 0, 

0, if Xk = 0, 

-1, if Xk < 0. 

For index sets M C M we dehne 

1m := : supp^ C M and ^k £ {—1,0,1} for all k G N} 

and the projections Pm ■ and Pm ■ ^ £^(N) by 

^k, if k e M, 

0, else. 

The following set of assumptions unihes the conditions used in [8] and 
m for obtaining convergence rates. 

Assumption 2.1. For each n G N let Ain be a family of index sets M C N 
with cardinality \M\ = n and assume that {1, ... ,n} G Ain- Then for each 
n G N and each 

ee IJ 1 m (2.2) 

M&Mn 

we assume that there is some rj = r]{n, G Y* with the following properties: 
(i) llhllv* ^ In for some constant > 0 independent of 
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(ii) Psupp^A*V = C, 

(iii) II (J — Psuppc)^*^||£°°(N) < c for some c G [0,1) independent of ^ and n. 
Typical choices of the families Ain are the extreme cases 


Mn = and = {M C N : |M| = n}. 


In the first case we have 


IJ = {^ e i°°{N) : supp ^ C {1,..., n} and ^ G In} 


MeMn 


in fl 2 . 2 p and in the second case 


1m = {^ e £°°(N) : I supp ^1 < n and ^ G In}- 


M&M' 


Theorem 2.2. Let Assumption \2.1\ he satisfied for some sequence (7Wn)nGN 
of families of index sets and assume that the corresponding sequence {jn)nm 
in (i) of Assumption \2.1\ contains an element jk such that jk < 

Then a variational inequality fl2.ip holds with 



(2.3) 


where p is a concave index function and c is taken from (iii) in Assump- 
tion \2.1\ The constant fi in fl2.ip attains the form fi = 

Remark 2.3. The assumption that 7 ^ < for some k is no relevant 

restriction since the 7 „ are upper bounds for the source elements 7 in As¬ 
sumption [2T] (i). We could choose a strictly increasing sequence here, for 
example. Without this additional assumption it might happen that (p is not 
strictly increasing. Nonetheless, p would still remain nondecreasing. 

On the other hand, in dni Theorem 4.11] it was shown that also varia¬ 
tional inequalities with nondecreasing but not necessarily strictly increasing 
function p yield convergence rates as long as p is strictly increasing in a 
small neighborhood of zero. This is indeed the case here without additional 
assumptions on the behaviour of the 7 ^. It suffices to show that there is 
some f > 0 with p{t) > 0, which is a consequence of Assumption 12. II and the 
boundedness of A*. Then concavity of p implies the assertion. 
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Proof of Theorem \2.‘A Set {3 = ^ with c G [0,1) from (iii) in Assump¬ 
tion [23] and fix a: G n G N, M G M.n- For 

^ := FMSgn(x - G (J 

M£Mn 

Assumption 12.11 provides r] ^Y* and 7 ^ > 0 such that 

llhllv* ^ 7n) C -FsuppgA Tj, II (J F’gupp^)A ?7ll^°°(N) ^ c. 

Thus, 

||FM(a; — x^)||£i(P}) = (^, X — x'^)£oo(pj)x£i(N) = (-PsuppgA*?7, X — a:^)£oo(pj)x£i(N) 

= (-Fsuppc^*h ~ A*r],x — x'*')£oo(f^)x£i(N) + {A*r],x — x'*')£oo(i^)x£1(n) 

= -((^ - ^suppc)^*h, {I - Pm){x - a^^))^oc(pj)x£i(N) + “ Ax^)y*xY 

< c||(/ - Pm){x - x'f)||£i(N) + 7 n||Ax - Ax'^lly 

and the triangle inequality yields 

||Pm(i-i*)||,i(K) < c(||(/- Pm)i||(1(n) + ||(/- PM)a:*|Ui(N))+T'nMl->ll’||y. 

(2,4) 

Now 

/3||x - x^||£i(N) - ||a;||£i(N) + H^^^ll^qN) 

= I3\\Pm{.x — x'^)||£i(N) + I3\\{I — Pm){x — a:'*^)||£i(N) “ IlFMa^ll^qN) “ IK-^ ~ PM)x\\ei(^) 

+ ||FMa^^||ri(N) + IK-^ ~ FM)a:^||£i(N) 

together with 

I3\\{I - Pm){x - X'^)||£1(N) < I3\\{I - PM)a:||^i(N) + - ^M)a:'^|l£i(N) 

and 

||FMa:^||£i(N) = ||FM(a: - x^ - x)||£1(n) < ||Pm(x - x^)||£1(n) + ||FMa:||£i(N) 
shows 

p\\x - x^ll^i(N) - ||x||£i(N) -f ||a;^||£i(N) 

— 2 ||(/ — -Pm) 2 ^^||£ 1 (n) + (1 + f^)\\PM{x — a^^)||£i(N) 

- (1 - /3) (II (J - Pm)x||,i(n) + II(/ - Pm)2:1,i(n)) . 
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Combining this estimate with the previous estimate 02.41) and taking into 
account that B = ^ and c = we obtain 

^ l+c 1+^ 

2 

/3||a:-a:^||£i(M)-|lx||p(N) + ||x^|l£i(N) < 2||(/-PM)a:^||£i(N) + T— 7 nPx-Ax^||y. 

X ~i~ c 

Taking the inhmum over all M G Ain and then over all n G N proves that (p 
has the form 02 .3p . 

It remains to show that 99 is a concave index function. At first we note that 
ip is concave and upper semicontinuous as the inhmum of affine functions. 
This implies continuity on the interior (0, cxo) of its domain. By Assump¬ 
tion [2T] we know that {1 ,... ,n} G Ain- Therefore 


00 

99 ( 0 ) = 2 inf inf ||(J - PM)a^^||G(N) < 2 inf = 0 . 

neNMGTMn II w ft I 

k=n+l 


Together with the nonnegativity and the upper semicontinuity this yields 
continuity of 99 at 0 and therefore on the whole domain [ 0 , cxo). 

To show that 99 is strictly increasing we hrst note that due to concavity 
it suffices to show 99 (^ 1 ) < 99 (^ 2 ) < ■ ■ ■ for some strictly increasing sequence 
(^m)mGN with tm -i- 00 a m ^ 00 . Set Cn := infMeMn II(-^ “ ^Ar)a^^llp(N) 
for n G N and choose k such that 7 ^ < inf;>fc 7 ;. If we choose the sequence 
(^m)mGN such that for each m G N 


then we see 


^ (1 + c) 


7n - Ik 


for all n > k, 


1 

Cfc T 9 ' 7fc i'm — Cn T 
l + c 


1 

1 i 

l + c 


for all n > k. 


Thus, the inhmum over n G N in (12.3p with t = tm is attained at some 
Hm < k. Consequently, 


+ (^m— 1 ) ^ 2Cn,^ + 


l + c 


Irim. tm-1 < 2Cn^ + 


l + c 


7n^ tm — 


for all m> 2. 


□ 
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Remark 2.4. If we choose Mn = {{1, • ■ ■, n}} then the inner infiniuni in 
fl2.3p becomes 

OO 

inf ||(/-FM)a:i|l£i(N) = |4l> 

IVl GyWn 

k=n+l 

which is a way to describe the decay of the components of the sequence 
Another way shows up if we choose Ain = {M C N : \M\ = n}. Then 

OO 

k=n-\-l 

where /t : N —?■ N is a reordering of N such that xj,for all A: G N. 

3 Smooth basis 

In [8] it was shown that convergence rates for ^^-regularization can be ob¬ 
tained even in case of nonsparse solutions if which is a Schauder 

basis in cq and in for all 1 < g < oo, satisfies the series of range condi¬ 

tions 

g(fc) _ 

some e y* and for all A: G N. (3.1) 
We mention that we always have weak convergence 

-^0 in y, (3.2) 

since is an orthonormal basis in £^(Id) with 6*-^^ ^ 0 in £^(N) and 

A : W —)■ y is a continuous linear operator. Then it holds TZ{A*) C Cq (cf. jBl 
Remark 2.5]). If the operator A and hence A are compact operators, then 
this is sufficient - but not necessary - to have even 

lim ||Ae^^i||y = 0, (3.3) 

k^oo 

and we refer to |12| regarding the distinction between the two cases fl3.2p 
and (13.3p . Under (13.3p the norms ||/^^^||y* of the source elements in 
(13.ip tend to infinity as A: —)■ oo. It is not difficult to see that (13.ip can be 
interpreted as some kind of smoothness of the orthonormal basis in 

the separable Hilbert space X, and we refer to [3] for several examples. On 
the other hand, as the following proposition shows it turns out that condition 
(13. ip is a special case of Assumption 12.11 in Section |2J 








Proposition 3.1. Assumption \2.1\ with Ain = and c = 0 in 

(Hi) is satisfied if and only if the condition is satisfied. The constants 
7 „ in (i) of Assumption IK1\ can he chosen as 7 „ = • 

Proof. With c = 0 in Assumption 12.11 items (ii) and (iii) together are equiv¬ 
alent to ^ = A*!]. To proof necessity of basis smoothness choose ^ in 

Assumption 12.11 To see sufficiency we write 

n n n 

^ = '^{sgnCk)A*f^^'> = A*'^{sgn ^k) f^^'^ 

k=l k=l k=l 


and estimate 


k=l 


n 

Y* k=l 


That is, Assumption 12.11 is satisfied with p = 


□ 


4 Nonsmooth basis 

In m it was shown that there are relevant examples where the operator 
A does not satisfy the condition fld.ip . which means that the corresponding 
orthonormal basis of the underlying Hilbert space is not smooth enough. 
Consequently, a weaker condition also yiedling convergence rates has been 
formulated there. The next proposition states that the assumptions of m 
are covered by Assumption 12.11 

Proposition 4.1. Assumption \2. 1\ with Ain = {{1,..., n}} is satisfied if for 
each n eN and all k E {1,... ,n} there are fAk) ^ y* such that 

(a) for each k E {1,..., n} we have [A* = Q for I E {1,..., n} \ A; 

and [A*fA>^')]k = 1, 

n 

(^) X] I < c for all I > n and some c E [0,1). 

k=l 

The constants c here and in Assumption \2.1\ (iii) coincide. The constants 7 „ 
in As sumption ] 2. 1\ (i) can be chosen as 7 „ = X]fc=i ll/*'"'’^^llv*■ 
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Proof. Assume that there are as in the proposition. Then for n E N 

and ^ as in Assumption 12.11 we have 

fcGsupp^ fcGsupp^ 


With 


= - {I - Psnp^i)A* Y1 

/c€supp^ /cGsupp^ 

>):= 5] 

/cGsupp^ 


this on the one hand yields 

^ = ^supp^^ = ^supp^^*h - ^supp$(/ - Psnppi)A*r] = Psnpp^A*!] 

and on the other hand 


\\{I .Psuppg)A ^7lk°°(N) 


E .n>)v/<"'‘> 

fcGsupp g 


£°°( 


= sup E &[v/(”y,<supEI[v/i”-‘'] 


l>n 


fcGsupp g 


l>n 


k=l 


< C. 


Thus, Assumption 12.11 is satisfied with 

n 

ln^h\\y<Y,\\f^"*'\ly- 

k=l 


□ 

Remark 4.2. In contrast to the case of basis smoothness we now do not 
have full equivalence of Assumption 12.11 and the assumptions in [TT]. But 
the interested reader may inspect the assumptions in detail and find that the 
difference between both concepts is only a tiny technicality and in no way 
substantial. 
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5 Restricted isometry property 


In [9] (see also m Section 5]) the condition 
Vn e N3Cn,7n e (0,CX)) such that Cn||a:|l£i(N) > \\Ax\\y > —||a:||£i(N) 

In 

for all X G with | suppa;| < n (5.1) 

is used to prove error estimates for the recovery of sparse signals, where 
I suppx| denotes the number of nonzero components in the inhnite sequence 
X = {xk)^=i- This condition is known as restricted isometry property or 
uniform uncertainty principle. In the following we will elucidate the relation 
of the lower bound 

||^a:|ly > —for all x G £^(N) with | suppx| < n (5.2) 

In 

to the results obtained in the previous sections. To distinguish it from the 
(twosided) uniform uncertainty principle, we will call it restricted injectivity 
property. The following proposition shows a tight connection to Assump¬ 
tion 12.11 

Proposition 5.1. The items (i) and (ii) of Assum,ption \Fl\ with 

Mn = {M CN:\M\< n} 

are satisfied if and only if condition (15.2p holds. The constants 7 „ coincide 
in both conditions for all n G N. 

Proof. Let (15.211 be satished and let x G £^(N). Then for each n G N and 
each hxed ^ as in Assumption 12.11 we can estimate 


|(^, x)£oo(p})x£l(N) 

< E \^k\ II-Psupp^^||£l(N) ^ T'n.||-^-^supp^^||y • 

/cGsupp ^ 

That is, ^ belongs to the subdifferential of the convex function x ^ 7n||^-Psupp^^||y 
at zero (cf. ^Ti Lemma 8.31]). In other words, there is some rj G Y* with 
ll^lly* ^ 7n such that 




A:€supp£ 


/c€supp£ 


^ = (APsupp^)*?? = PsnppiA*r]. 
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Now assume that (i) and (ii) of Assumption 12.11 are true. Fix n G N and 
X G £^(N) with I supp x\ < n. Set ^ = sgnx. Then there is some rj gY* with 
llhlln* ^ In such that ^ = Fgupp^A*p, which is equivalent to 

|(^,x)£oc(p^)x£i(N)| < 7 n||- 4 Fgupp^x||Y for all x G f{N) 

(again by Lemma 8.31]). Choosing x = x m this inequality we see 
£°°(N)x£i(N)| = ll^^lkpN) and Fgupp^ai = x, which completes the proof. □ 

From the proposition we deduce that the restricted injectivity property 
fl5.2p can be used to prove convergence rates for ^^-regularization even if the 
solution is not sparse. One only has to add Assumption 12.11 fiiil. 

Proposition 5.2. (a) The condition \5.‘A] cannot hold whenever 4 7. 71) is 
valid, (b) If 45.^1) holds, then we have 

0 < 7i < 72 < < 7n < 7n+i exo as n ^ oo (5.3) 

for the constants 7 „ in 45. 2\} . 

Remark 5.3. Part (a) tells us in particular that no compact operator A 
satisfies the restricted injectivity property fl5.2p . Part (b) implies: If (13.31) 
fails and only (13.2p is valid, then due to the ill-posedness of equation (II.2p 
expressed by TZ{A) ^ TZ{A), which always takes place under the setting of 
the present paper, we have in case of the validity of the restricted injectivity 
property the condition (15.31) for the constants 7 „ in (15.2p . Moreover, taking 
into account Proposition 15.11 this condition also applies to the corresponding 
constants 7 ^ in Assumption 12.11 (i). 

Proof. The inequality 7 ^ < 7 n+i for all n G N is evident by inspection of 
formula (15.2p . Substituting x := with | supp(e^”'^)| = 1 into (15.2p we have 

||Ae(")||Y>-||e(")||p(N) = -> 0 . 

7i 7i 

This contradicts (13.3p and establishes claim (a). If ( 7 n)neN is bounded then 
there is some constant c > 0 such that — > c for all n G N in (15.21) . 

7n v—y 

Consequently, for x = (x^)^^ G £^(N) and := {xi ,..., 0, 0,...) 

I supp(P„x)| < n and lim ||x — P^xjl^pm = 0 

n—>-oo ^ 
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and furthermore 


||v4P„a;||y > c ||Pn£||£i(N) for all n G N. 

Since A is bounded and x was an arbitrary element in £^(N) we even have 
||Aa;||y > c ||x||£i(N) for all x G 

This, however, contradicts the ill-posedness of the problem expressed by 

TZiA) ^ n{A). □ 


6 Examples for the restricted isometry prop¬ 
erty 


We present two examples satisfying the restricted injectivity property, hence 
Proposition 15.11 can be applied to them. In fact, the examples obey the full 
uniform uncertainty principle fIS.ip as well, with explicitly known constants. 

Example 6.1 (Denoising). We apply (II.ip to solve a denoising problem 
based on equation fll.2p with Y = 1 < q < oo, the noncompact 

embedding operator A : ^^(N) —)■ satisfying 'R,{A) ^ TZi^A), and noisy 

data G (cf. [121 Section 5]). Then we have for x G with 

I suppx| < n the estimates 





n 

E Wi 

> _ 


|3:^||g(N) 


and obviously (15.2p with 7 „ = Tn}~^A for 1 < g < cx) and 7 „ = n in the 
limit case q = oo. The constants 7 „ tend always to inhnity as n ^ ex. By 
the well known inclusion C £'?(N) with ||x|l£ 9 (i^) < ||a:||£i(p}), it follows 

immediately that the twosided restricted isometry property (15. ip holds with 
Cn = 1 for all 77, G N. 

Example 6.2 (Restriction operator on the Wiener algebra). Let X be the 
Wiener algebra, i.e., the vector space of all complexvalued functions / on the 
unit circle T attaining the form 


/(t) = with xei\Z) 

kez 
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equipped with the norm 


X — 


E 


XkG 


2'Kikt 


\Xk\ 


= 




fcGZ 


Given a measurable subset EOT with positive Lebesgue measure li?! > 0 
we consider the operators 


L ; e\Z) ^ X, (xfc)+r-oo ^ 

fcez 

Ae:X^Y:=L°^{T), AeJ = XeJ- 


Here L°°(T) is equipped with the sup-norm || ■ ||loo(t) and xe denotes the 
characteristic function of E (one on E, zero else). The Turan Lemma in the 
version of Nazarov (cf. [19]) says: 

Lemma 6.3 (Nazarov). Let n G N, Xi,... a:„ G C, rrii < ■ ■ ■ < rrin G Z and 

n n 

p,(z) = 

k=l k=l 


be a trigonometric polynomial on T and EOT measurable with \E\ > 0. 
Then 

sup|p(f)| < IIxbtIU-(t) (6.1) 

This is a typical uncertainty principle from harmonic analysis. Set Ae = 
AeoL: £^(Z) — )■ L°°(T) and rewrite (16.11) for any x G £^(Z) with | suppx| < n 
as 





uy-^ ~ 

\\^e{Px)\\l^{t) = 


14 


n—1 


\\Aex\\l°°{t)- ( 6 . 2 ) 


Thus Ae satishes the uniform uncertainty principle (and thus in particular 
the restricted injectivity property) 


— Ila;||£i(z) < II^E2;||y < \\Lx\\y = ||Lx||Loc(Tr) < \\Lx\\x = ll^^ll^pz) (6.3) 

In 
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for all X G with | suppx| < n, where, for alle n G N, 


In = 



W\) 


Now we choose an arbitrary function T —)■ (0,1] such that g > Xe where 
i? C T is as above. Let M = Mg \ L°°(T) —)■ L°°(T) be the multiplication 
operator by g and A = Ag = Mg o L. Note that the inverse of M is given 
by the multiplication by the function ^ which is well dehned, but can be 
arbitrarily unbounded, depending on the specihc choice of g. The bounds 
fl6.2p and fl6.3p remain valid if is replaced by Ag, with the same constants. 
Thus Ag satishes a uniform uncertainty principle and in particular a restricted 
injectivity property. 

Remark 6.4. The clou in the Turan lemma is that only the order and not 
the degree of the polynomial enters! There exist multi-dimensional analogs 
of the Wiener Algebra and of the Turan-Nazarov Lemma. 
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Proposition 5.1 establishes a relation between source conditions as used in jS] 
and m and a low-dimensional or restricted injectivity property. The latter 
property is part of the famous restricted isometry property (15.ip . It is used, 
cf. e. g. [9], to solve approximately specihc inverse problems for non-injective 
linear maps. The approximation error can be given explicitly as a function 
of the constants Xn and ^n, n G N appearing in (I5.ip . 

In view of Proposition 5.1. the following question imposes itself: Can 
property (hi) in Assumption 12.11 be reformulated in a way similar to the re¬ 
stricted injectivity property, i.e. without adhering to the adjoint A*? Note 
that one could slightly generalise property (iii) by requiring only ||(/ — 
Psuppc)A*r 7 ||ioo(T) < Cn for some Cn G [0,1) independent of This questions 
and the application of uniform uncertainty principles to ill posed inverse 
problems in general will be pursued in a sequel paper. 
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